TIL: For long-lived LLM sessions, swapping KV Cache to RAM is ~10x faster than recalculating it. Why isn't this a standard feature?
reddit.com·19h·
Discuss: r/LocalLLaMA
🦙Simple finetuning LLMs
Flag this post
Kimi Linear: An Expressive, Efficient Attention Architecture
arxiviq.substack.com·11h·
Discuss: Substack
📊Vector Databases
Flag this post
Cycle-accurate 6502 emulator as coroutine in Rust
github.com·19h·
Discuss: Hacker News, r/programming, r/rust
🔥Svelte
Flag this post
From hours to seconds: AI tools to detect animal calls
seangoedecke.com·3h·
Discuss: Hacker News
📊Vector Databases
Flag this post
Opportunistically Parallel Lambda Calculus
dl.acm.org·2d·
Discuss: Hacker News
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
Llmtext – an open source toolkit for llms.txt adoption
llmtext.com·2d·
Discuss: Hacker News
🦙Simple finetuning LLMs
Flag this post
How fast can an LLM go?
fergusfinn.com·2d·
Discuss: Hacker News
📊Vector Databases
Flag this post
No Cap, This Memory Slaps: Breaking Through the OLTP Memory Wall
danglingpointers.substack.com·2d·
Discuss: Substack
🦙Simple finetuning LLMs
Flag this post
Show HN: Using GitHub Pages as zero-cost APT repository with global CDN
vejeta.com·15h·
Discuss: Hacker News
🧩WASI
Flag this post
Writing an LLM from scratch, part 25 – instruction fine-tuning
gilesthomas.com·3d·
Discuss: Hacker News
🦙Simple finetuning LLMs
Flag this post
DGX Spark UMA can trick you
bartusiak.ai·1d·
Discuss: Hacker News
🔥Svelte
Flag this post
From Lossy to Lossless Reasoning
manidoraisamy.com·1d·
Discuss: Hacker News
🤖Coding Automation
Flag this post
Your Transformer is Secretly an EOT Solver
elonlit.com·2d·
Discuss: Hacker News
📊Vector Databases
Flag this post
Linux/WASM
joelseverin.github.io·13h·
Discuss: Hacker News
🧩WASI
Flag this post
Can you save on LLM tokens using images instead of text?
pagewatch.ai·11h·
Discuss: Hacker News
🔵LLM frameworks and AI libraries for TypeScript
Flag this post
Text rendering and effects using GPU-computed distances
blog.pkh.me·16h·
Discuss: Lobsters, Hacker News
🔥Svelte
Flag this post
Machine Scheduler in LLVM – Part II
myhsu.xyz·3h·
Discuss: Hacker News
🦙Simple finetuning LLMs
Flag this post
I built a lightweight HTTP bridge for AnythingLLM to safely run multiple local MCPs inside Docker (Dummy + Time demo included)
github.com·13h·
Discuss: r/LocalLLaMA
🧩WASI
Flag this post
Nim 2.2.6
nim-lang.org·1d·
Discuss: Hacker News
🧩WASI
Flag this post
Yes, you should understand backprop (2016)
karpathy.medium.com·4h·
Discuss: Hacker News
🦙Simple finetuning LLMs
Flag this post